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A conditional  lower  bound  on  the  minimand  of  an  integer  program  is 
a number  which  would  be  a valid  lower  bound  if  the  constraint  set  were 
amended  by  certain  inequalities,  also  called  conditional.  If  such  a 


conditional  lower  bound  exceeds  some  known  upper  bound,  then  every 
solution  better  than  the  one  corresponding  to  the  upper  bound  violates  at 
least  one  of  the  conditional  inequalities.  This  yields  a valid  disjunction, 
which  can  be  used  to  partition  the  feasible  set,  or  to  derive  a family  of 
valid  cutting  planes.  In  the  case  of  a set  covering  problem,  these  cutting 
planes  are  themselves  of  the  set  covering  type.  The  family  of  valid 
inequalities  derived  from  conditional  bounds  subsumes  as  a special  case 
the  Bellmore-Ratliff  inequalities  generated  via  involutory  bases,  but  is 
richer  than  the  latter  class  and  contains  considerably  stronger  members, 
where  strength  is  measured  by  the  number  of  positive  coefficients.  We 
discuss  the  properties  of  the  family  of  cuts  from  conditional  bounds,  and 
give  a procedure  for  generating  strong  members  of  the  family.  Finally,  we 
outline  a class  of  algorithm  based  on  these  cuts.  Our  approach  was 
implemented  and  extensively  tested  in  a computational  study  whose  results 
are  reported  in  a companion  paper  [21.  The  algorithm  that  emerged  from  the 
testing  seams  capable  of  solving  considerably  larger  set  covering  problems 


than  earlier  methods. 
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A NEW  APPROACH  TO  SET  COVERING 
by 

Egon  Balas 

1.  Introduction 

We  consider  the  set  covering  problem 
(SC)  min  {cx  | Ax  > e,  Xj  * 0 or  1,  j { H] 

where  A = (a_)  is  mXn,  e e Rm,  e = (1 1) , c e Rn,  and  a^.  e (0,1}, 

i e M = {l,...,m],  j « N • {l,...,n}.  We  will  denote  by  a*  and  a^  the 
i-th  row  and  j-th  column  of  A,  respectively.  Without  loss  of  generality, 
we  assume  that  c^  > 0,  Vj  e N.  Using  established  terminology,  we  call  a 
vector  x satisfying  the  constraints  of  (SC)  a cover,  and  the  set  of  indices 

j such  that  Xj  = 1,  the  support  of  the  cover.  A cover  is  called  prime  if 

no  proper  subset  of  its  support  defines  a cover. 

This  problem,  and  its  equality-constrained  counterpart,  the  set 
partitioning  problem,  are  useful  mathematical  models  for  a great  variety 
of  scheduling  and  other  important  real  world  problems,  like  crew  scheduling, 
truck  delivery,  tanker  routing,  information  retrieval,  fault  detection, 
stock  cutting,  offshore  drilling  platform  location,  etc. , and  a literature 
of  considerable  sise  exists  on  solution  methods  for  these  models  (see  [9] 
for  a survey  of  set  covering  and  set  partitioning;  [7]  for  a computational 
study  and  comparison  of  several  solution  techniques;  and  [4]  for  a more 
recent  survey  of  set  partitioning,  which  also  contains  a bibliography  of 
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applicatioas  of  both  models). 

In  this  paper  we  propose  a new  approach  to  set  covering,  based  on 
the  idea  of  conditional  bounds.  In  section  2 we  introduce  this  concept 
for  arbitrary  mixed  integer  programs,  and  show  how  it  can  be  used  to 
derive  valid  disjunctions.  The  latter  in  turn  can  be  used  either  to 
partition  the  feasible  set  in  the  framework  of  a branch  and  bound 
approach,  or  to  derive  a family  of  valid  cutting  planes.  In  case 
of  a set  covering  problem,  the  cutting  planes  derived  from  conditional 
bounds  are  themselves  of  the  set  covering  type.  These  cuts  are  discussed 
in  section  3,  where  the  Bellmore-Ratliff  inequalities  generated  from 
involutory  bases  are  shown  to  be  a special  case  of  the  larger  family  of 
inequalities  defined  in  this  paper.  In  section  4 we  examine  some  basic 
properties  of  our  cutting  planes.  The  family  of  cuts  from  conditional 
bounds  is  rather  large,  and  in  section  5 we  discuss  a procedure  for 
generating  "strong"  members  of  the  family.  Section  6 outlines  a class  of 
algorithms  based  on  the  cutting  planes  introduced  in  this  paper,  and  using 
heuristics  as  well  as  subgradient  optimization  rather  than  the  simplex 
method.  Several  versions  of  this  approach  were  implemented  and  tested 
computationally  in  a joint  study  of  Andrew  Ho  and  the  author,  that  is 
summarized  in  a companion  paper  [2],  The  algorithm  that  emerged  from 
this  testing  seems  capable  of  solving  larger  problems  in  less  time  and 
more  reliably  than  earlier  methods. 

The  approach  discussed  here  was  first  circulated  under  [11. 

2 . Pis  junctions  from  Conditional  Bounds 

The  central  idea  of  our  approach  is  to  derive  valid  inequalities  for 
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the  set  covering  problem  from  conditional  bounds.  Since  this  concept  is 
valid  and  useful  for  arbitrary  mixed  integer  programs,  we  will  Introduce 
it  in  this  more  general  context. 
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In  solving  pure  or  mixed  integer  programs  by  branch  and  bound,  if 
the  feasible  set  is  tightly  constrained,  it  is  sometimes  possible  to  derive 
disjunctions  stronger  than  the  usual  dichotomy  on  a single  variable.  On  the 
other  hand,  the  feasible  set  of  any  integer  program  becomes  more  or  less  tightly 
constrained  after  the  discovery  of  a "good"  solution  (in  particular,  of  an 
optimal  solution) , provided  that  one  restricts  it  to  those  solutions  better 
than  the  current  best.  Such  a "tightly  constrained"  state  of  the  feasible  set 


can  often  be  expressed  in  the  form  of  an  inequality  ttx  < n with  rr  > 0 and 


tt  > 0,  as  will  be  discussed  later  on.  The  smaller  n relative  to  the  other 
o o 


coefficients  tt  the  tighter  the  inequality.  Whenever  such  an  inequality 


J 


is  at  hand,  the  following  result  can  be  used  to  generate  a valid  disjunction. 


Here  we  denote  disjunction  by  the  symbol  V,  and  the  meaning  of 
k 

V \ 


V A = A v A v. 

i-1  1 


is  that  at  least  one  of  the  conditions  A.) , . . . ,A^  must  hold. 

"heorem  1.  Let  ttsR",  noeR+,  N = {l, . . . ,n},  and  Q C N,  i - 1, . . . ,p, 
1 •_  p < n.  There  exists  veR^  such  that 
(1)  E v.  < n, . I eN 


. 2 v < tt  j( 

i I J j 


and 

(2) 


E v.  > ", 
i-1  1 ° 


if  and  onlv  if  every  integer  xeRn  that  satisfies  nx  < tt  also  satisfies 

+ — o 

the  disjunction 


(3) 


V (x  = 0,  jcQ  ). 
i-1  1 1 


Proof.  Let  G - (g^)  be  the  pXn  matrix  defined  by 


(4) 


g 


ij 


j «N  \Q . 


1*1, 


,P, 


and  let  e - (1,..,1)  have  p components.  From  (1)  and  (2),  G contains  as  a 
submatrix  the  identity  matrix  of  order  p,  whose  columns  are  J(i),  i-1,..., p. 


J 
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From  Farkas'  Theorem  of  the  Alternative  (nonhomogeneous 
Duffin  f 8]  ),  one  and  only  one  of  the  following  two  systems  has 
(here  T denotes  transpose): 

^ ev  > TT 

^ - 1 tt 

■s 


version,  see 
a solution 


System  II  is  the  same  as  (1),  (2),  and  veR^.  Thus  there  exists  veR^ 

satisfying  (1)  and  (2)  if  and  only  if  system  I has  no  solution,  i.e.,  if  and 

only  if  every  xeR"  such  that  ttx  < n , violates  at  least  one  inequality  of 

Gx  > e.  But  an  integer  xeR^  violates  the  i-th  inequality  of  Gx  > e, 

i.e.,  the  inequality 

E x > 1, 

jeQi  J 

if  and  only  if  it  satisfies  x^.=0,  jeQ^:  hence  it  violates  at  least  one 
inequality  of  Gx  > e if  and  only  if  it  satisfies  the  disjunction  (3)  J| 


Example  1.  The  inequality 


9x1+8x2+8x3+7x4+7x5+6x6+«x7+5x8+5x9+5x1044x11+4x12+3x13+3x14+3x15+2x16+2x17  < 


together  with  the  condition  x > 0,  x^  integer,  V j,  implies  the  disjunction 

(Xj  - 0,  j - 1,2, 3, 4, 5, 6, 7)  V (x  - 0,  j ■ 1,8,9,10,11,12,13,14)  v 

v (*  » 0,  j - 2,3,8,9,10,15,16,17). 

Indeed,  setting  v^  » 6,  v2  - 3 and  v3  = 2,  we  have  6 + 3 + 2 > 10, 
i.e.,  (2)  holds;  and  defining  the  sets  C^,  i - 1,  2,  3,  to  be  those  used 
in  the  above  disjunction,  condition  (l)  is  satisfied.  This  can  easily  be 
seen  from  Table  1,  whose  rows  are  the  incidence  vectors  of  the  sets  , 
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while  the  numbers  on  top  are  the  tt^  and  those  to  the  right  are  the  v^. 
columns  of  the  table  correspond  to  the  inequalities  (1),  which  for  the 


The 


6 

3 

2 


vector  v = (6,  3,  2)  are  6 + 3 < 9,  6 + 2 8,...,  2 < 2,  all  satisfied. 

Remark  1.  1 Theorem  1 remains  true  if  me  < tt^  is  replaced  by  ttx  < tt^ 
and  (2)  is  replaced  by 


9 

8 

8 

7 

7 

6 

6 

5 

5 

5 

4 

4 

3 

3 

3 

2 

2 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

Table  1. 


P 

(2')  T.  v > tt 

i=l  1 ° 

Proof.  If  the  indicated  changes  are  made  in  systems  I and  II,  the 
Theorem  of  the  Altenative  still  holds.)) 

One  way  of  obtaining  a "tight"  inequality  me  < no  (or  me  ^ ttq)  in 
order  to  derive  from  it  a conveniently  strong  disjunction,  is  as  follows. 
Consider  the  mixed  integer  program 


(P)  mix  [cx|Ax>b,  x>0,  x^  integer,  jeN^  £N], 

let  Zy  be  a known  upper  bound  on  the  value  of  (P),  and  let  the  vectors 
u and  s satisfy 


(5)  u > 0,  s = c - uA  > 0. 

Then  multiplying  Ax  > b by  -u  and  adding  the  resulting  inequality, 

-uAx  < -ub,  to  cx  < Zy,  yields  the  inequality  sx  < Zy  - ub,  satisfied  by 
every  feasible  solution  x to  (P)  such  that  cx  < Zy.  Using  this,  and  setting, 
for  i=l vi’sj(i)  for  sonie  n's  and  rr0“zu"ub’  than  ■PP1yln8  the 
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"only  If"  part  of  Theorem  1,  as  modified  by  Remark  1.1,  we  obtain  the  following. 

Corollary  1.2.  Let  zy  be  an  upper  bound  on  the  value  of  (P),  and  let  u,  s 
satisfy  (5).  If  there  exists  SCS^,  S={j  (1) , . . . , j (p) },  l<p<|N  |,  such  that 

(6)  E s > z - ub, 
j eS  j U 

then  for  any  collection  uf  sets  C , 1 = 1,...,  p,  such  that 

( 7 ) E j sN * 

ilJcQi  j(i)  j 

every  feasible  solution  x to  (P)  for  which  cx  ^ Zy,  satisfies  the  disjunction 
P 

(3)  i=l^xj  = 

Note  that  if  p=l,  i.e.,  (3)  has  a single  term,  then  (3)  converts  to 
the  condition  x^  = 0,  jeQ^.  Somewhat  more  generally,  we  have 

Rema rk  1.3.  Let  Zy,  u and  s be  as  in  Corollary  1.2,  and  define 

Q0  = tjcN1|sj  > Zy  - ub}. 

Then  every  feasible  solution  x to  (P)  such  that  cx  < z7T  satisfies  x.  * 0,  jcQ  . 

U J O 

Corollary  1.2  has  an  interpretation  (and  alternative  proof)  in  terms 
of  conditional  bounds,  which  yields  some  insight  and  is  appealing  to 
intuition.  Consider  the  pair  of  dual  linear  programs 

(L)  min  {cx|Ax  > b,  x > 0} 

and 

(D)  max  {ubluA  < c,  u > 0 } , 

associated  with  (P) . 

Clearly,  for  any  u feasible  to  (D) , ub  is  a lower  bound  on  the  value 

L 
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of  (L) , hence  of  (P).  Now  suppose  the  constraint  set  of  (P)  (and  (L))  is 
amended  by  the  system  Gx  > e defined  by  (4).  Then  (L)  and  (D)  become 


(L^)  min  fcx|Ax  > b,  Gx  > e,  x > 0} 

and 

(Dg)  max  {ub  + vejuA  + vG  < c,  u > 0,  v > 0} 


respectively,  and  ub  + ve  is  a lower  bound  on  the  value  of  (L^,),  hence 

of  (Pp),  the  problem  obtained  from  (P)  by  adding  to  its  constraints  Gx  > e. 

Now  if  a vector  v can  be  found  that  together  with  G satisfies  the  constraints 

of  (D„ ) and  ub  + ve  > z , then,  since  cx  > ub  + ve,  every  feasible  solution 

to  (L-),  hence  to  (P„),  satisfies  cx  > z . It  follows  that  every  feasible 
G G U 

solution  x to  (P)  such  that  cx  < z^,  must  violate  the  constraint  set  Gx  > e, 
hence  (as  x^  is  integer-constrained  for  jeN^)  must  satisfy  the  disjunction  (3), 
If  we  set  v^,  = i=l,...,p,  with  s defined  as  in  (5),  then  the  above 

conditions  on  v are  a paraphrase  of  (6),  (7),  and  we  obtain  Corollary  1.2. 

The  inequalities  Gx  > e are  not  part  of  the  problem  (P) , and  the  sole 
purpose  of  introducing  them  is  to  conclude  that  if^  they  wt  e to  hold,  that 
would  imply  a lower  bound  at  least  equal  to  the  upper  bound  z^,  hence  any 
solution  x better  than  the  one  that  produced  z^,  must  violate  at  least  one 
of  them.  We  therefore  call  these  inequalities,  as  well  as  the  lower  bound 
obtained  from  them,  conditional. 

In  a broader  context,  the  idea  of  deriving  a valid  ("unconditional") 
constraint  from  one  or  several  conditional  constraints  may  have  many 
other  applications.  One  of  them  appears  in  a recent  paper  by  Kovacs  and 


Dienes  [101,  where  a properly  chosen  inequality  is  used  to  derive  a bound 
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from  the  fact  that  either  the  inequality  or  its  complement  must  be  satisfied 
by  any  feasible  solution. 

From  Corollary  1 ',  a valid  disjunction  (3)  can  be  derived  for  the 
problem  (P)  if  an  upper  bound  Zy  is  known,  a feasible  solution  u to  the 
dual  linear  program  (D)  is  at  hand,  and  a subset  S of  N,  can  be  found  for 
which  (6)  holds.  This  latter  condition  is  usually  easy  to  satisfy,  and 
we  will  have  more  to  say  about  this  later  on.  Given  such  a set  S,  however, 
every  collection  of  subsets  of  N^  that  satisfies  (7)  gives  rise  to  a 
valid  disjunction  (3),  and  the  question  arises  of  choosing  one  that  yields 
a disjunction  as  "strong"  as  possible,  i.e.,  one  with  p as  small  as 
possible,  and  the  sets  , i=l,...,p,  as  large  as  possible.  Next  we 
state  a simple  heuristic  that  generates  a disjunction  (3)  with  that 
objective  in  mind. 

1.  Choose  a minimal  subset  S C N such  that 


-9- 


Note  that,  by  construction  of  the  sets  Q, , s.  >s...,  >0  for  ieQ., 

i J ~ j(i)  i 

i = 1,...,  p,  and  thus  on  all  branches  except  the  one  corresponding  to  i = 1, 
the  lower  bound  ub  given  by  the  dual  solution  associated  with  the  reduced 
cost  vector  s,  can  be  strengthened  immediately  after  branching,  by  associating 
with  each  inequality 


Z x.  > 1 

jsQk  J 

the  positive  multiplier  x^ ^ • In  other  words,  on  the  i-th  branch  (i  > 1) 

the  lower  bound  ub  can  be  replaced  right  after  branching  by  ub  + s j (i)+* • •+s • ^ 

The  above  described  branching  rule,  while  often  considerably  stronger 
than  the  traditional  one,  can  occasionally  be  a lot  weaker.  Therefore,  the 
best  way  of  using  it  is  to  judiciously  combine  it  with  other  branching  rules, 
according  to  criteria  that  make  sure  it  is  only  used  at  such  nodes  of  the 
search  tree  where  it  can  be  expected  to  perform  relatively  well.  It  is  in 
this  fashion  that  disjunctions  of  the  type  (3)  are  being  successfully  used 
for  branching  in  our  set  covering  algorithm  that  also  uses  them  to  generate 
cutting  planes  (see  the  companion  paper  [2]),  and  in  a restricted 
Lagrangean  algorithm  for  the  traveling  salesman  problem  [7]. 

Next  we  turn  to  the  other  use  of  disjunctions  of  type  (3),  namely 

for  generating  cutting  planes.  In  the  case  of  the  set  covering  problem, 

these  cutting  planes  turn  out  to  be  of  the  same  type  as  the  original 
constraints . 

3.  The  Cutting  Planes 

From  now  on,  we  address  ourselves  to  the  set  covering  problem 


(SC)  min  {cx|Ax  > e,  x.  = 0 or  1,  j«N) 


i 
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introduced  in  section  1.  (Here  A is  m X n) . We  will  denote 


N.  = {jeN|a..  = l},  i 


eM. 


Consider  the  i-th  term  of  a disjunction  (3),  i.e.,  x.  = 0,  jeQ^. 


Clearly,  every  cover  x that  satisfies  the  i-th  term  of  (3),  also  satisfies 
the  inequalities 


Z x > 1,  hgM 
1 


and  hence,  for  any  choice  of  indices  h(i)gM,  i=l,...,p,  every  cover  that 
satisfies  (3),  also  satisfies  the  disjunction 


V ( Z x > 1), 
1=1  jeNh(i)XQi  ' 


which  is  easily  seen  to  imply  (for  integer  x)  the  inequality  Ex^  > 1,  with 


the  summation  taken  over  the  union  of  the  sets  > 1=1,..., p. 

Combining  this  reasoning  with  Corollary  1.2  yields  the  following. 

Theorem  2 . Let  be  an  upper  bound  on  the  value  of  (SC),  and  let 
u,  s satisfy  (5).  If  there  exists  a set  of  column  indices  S = (j (1) , . . . , j (p) } , 
M S c N,  such  that 


(8) 


E s.  > Zy  - ue, 
j eS  J 


then  for  any  set  of  p row  indices  h(i)eM,  i=l,. 
p subsets  Q/TN,  1=1,..., p,  satisfying 


,,p,  and  any  collection  of 


(7) 


~ 3j'  JeN' 


every  cover  x such  that  cx  < zy  satisfies  the  inequality 


(9) 


E x > 1, 


j eW 
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where 


(10)  W = U (N  \Q  ). 

i=l  h(l)  1 

Rema rk  2 . 1 The  family  of  cuts  (9)  remains  the  same  if  the  condition 
in  Theorem  2 is  replaced  by  , 1=1,..., p. 

Proof . From  (]0),  the  change  does  not  affect  the  set  W which  defines 
inequality  (9)J| 

The  inequalities  (9)  are  valid  cutting  planes  in  the  sense  of  being 
satisfied  by  every  cover  better  than  a given  one.  Further,  they  are  of  the 
set  covering  type.  Since  these  properties  are  the  same  as  those  of  the 
Bellmore-Ra tli ff  cuts  [51  obtained  by  the  use  of  involutory  bases,  we  next 
examine  the  relationship  between  the  latter  and  our  inequalities  from 
conditional  bounds.  First,  we  show  that  the  Bellmore-Ratliff  inequalities 
are  a subclass  of  the  class  of  inequalities  (9).  Then  we  show  by  way  of 
example  that  the  subclass  in  question  is  a proper  one. 

Theorem  3.  The  Bellmore-Ratliff  inequalities  [51  are  a subclass  of 
the  class  defined  in  Theorem  2, 

Proof.  Let  x be  a prime  cover,  B an  involutory  basis  associated 

with  x,  and  c.  - c_a.  the  j-th  reduced  cost,  where  c_  is  the  m-vector 

J B J B 

whose  i-th  component  is  c^  ^ , if  the  basic  variable  associated  with  row  i 

is  (the  structural  variable)  x^ ^ , and  0 if  the  basic  variable  associated 

with  row  i is  slack.  (When  B is  an  involutory  basis,  the  reduced  costs 

are  known  to  be  of  this  form).  Let  the  columns  of  B be  indexed  by  I,  and 

denote  F = {jeNlc  -c  a <0].  The  Bellmore-Ratliff  cut  associated  with  x and 
J ° J 

B is  then 


Z x > 1. 
jeF  J 


(ID 
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To  obtain  this  cut  via  our  procedure,  set  S = ICN,  S = { j (1) , . . . , j (p) } , 
i.e.,  let  S be  the  index  set  of  the  basic  structural  variables,  and  set  u = 0, 
s = c.  Then  u and  s satisfy  (5),  and  S satisfies  (8)  (with  equality)  for  z^=cx. 

Next  let  h(i)  be  the  row  index  associated  with  basic  variable  x 
and  set  = Nh(i)vF’  i = l,...,p.  It  is  easy  to  see  that  these  sets 
satisfy  (7).  Substituting  for  in  (10)  then  yields 

.OF. 


W 


P 

i=l  h(i) 


On  the  other  hand,  from  the  definition  of  F it  follows  that  j eF  implies 

jeNh 

F £ (j^hd)) 

and  therefore  W = F.  Thus  (11)  is  a special  case  of  (9). 'I 

Note  that  the  cutting  planes  derived  by  Bowman  and  Starr  [6)  via  a 
vector  partial  ordering  are  a special  case  of  the  Bellmore-Ratliff 
inequalities,  hence  they  can  also  be  obtained  by  our  procedure. 

Next  we  illustrate  by  an  example  the  fact  that  the  Bellmore-Ratliff 
inequalities  are  a proper  subclass  of  the  class  of  inequalities  (9),  and 
in  some  cases  those  inequalities  (9)  that  cannot  be  derived  by  the  Bellmore- 
Ratliff  procedure  are  considerably  stronger  than  the  ones  that  can. 

Example  2.  Consider  the  set  covering  problem  whose  costs  c.  and 
coefficient  matrix  A are  shown  in  Table  2. 

The  0-1  vector  x whose  support  is  {2,3,5,12,13,17}  is  a cover, 
satisfying  with  equality  all  the  inequalities  except  for  1 and  8,  which 
are  oversatisfied.  The  Bellmore-Ratliff  procedure  generates  cuts  from  the 
involutory  bases  that  can  be  associated  with  x,  and  it  can  obtain  one  cut  from 
every  such  basis.  The  variables  x^,  x^  and  4,.  can  be  basic  only  in  rows 


(i) 


for  some  ie{l,...,p],  hence 
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The  4 cutting  planes  that  can  be  obtained  by  the  Bellmore-Ratliff 
procedure,  depending  on  which  basis  Is  used,  are 


1 


x6  + X9  + X10  + X15  + X16  + x18  + X20  - 1 * from  ®2 


x4  + x6  + x9  + x10  + X11  + *19 


> 1 , from  Bc 


Xfe  + X7  + X10  + X15  + X19  + X20 


> 1 , from  B. 


x6  + x8  + X10  + X14  + X18  + X20 


> 1 , from  B^. 


On  the  other  hand,  using  the  conditional  bound  approach,  we  construct 
(by  inspection  or  a heuristic)  the  dual  vector  u « (0, 1 , 1 , 1 , l, 1 ,2 ,0, 1 ,2 ,2) 
which,  together  with  the  associated  reduced  cost  vector 


(2, 0,0, 2, 0,0, 0,1, 1,0, 1,1, 1,1, 1,0, 0,2, 0,1), 


satisfies  the  condition  (5). 

The  cover  x whose  support  is  {2,3,5,12,13,17}  yields  = cx  - 14; 
and  the  dual  vector  u yields  the  lower  bound  ue  * 12. 

Since  - ue  = 2,  Qq  * {jcN|s.  > 2}  » fl,4,18],  and  thus  (Remark  1.3) 
every  cover  better  than  x satisfies  x^  * x^  * x^g  » 0.  Hence  we  replace  N 
by  N\{l,4,18}.  Further,  to  apply  Corollary  1.4,  we  pick  the  column  indices 
j(l)  * 12,  j(2)  * 13;  for  which  (8)  holds,  since  s^2  + s^  « s > Zy  - ue. 

Next  we  pick  the  row  indices  h ( 1 ) » 8,  h(2)  * 5,  and  choose  the  sets  Qj  * {12,13],  • 

Q2  - {9, 11},  to  obtain  Nh(t)\Q1  - {6,19}  and  Nh(2)  - {10,16,19},  hence 

W - {6,10,16,19}.  In  choosing  the  sets  we  make  sure  that  (7)  is  satisfied, 
and  apart  from  that  try  to  make  each  successive  N,  add  to  W as  few 

new  elements  as  possible.  We  have  thus  obtained  the  cut 


+ x 


10 


+ x 


16 


X19  - 


which  has  only  4 positive  coefficients,  whereas  each  of  the  involutory 
basis  cuts  has  at  least  6. 
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The  above  inequality  cuts  off  x.  This  is  due  to  the  way  we  chose  the 
column  indices  j(i)  and  the  row  indices  h(i),  i=l,...,p,  as  will  be  shown 
in  the  next  section.  If  we  do  not  care  about  cutting  off  a specified 
cover,  we  can  obtain  inequalities  which  are  "stronger"  in  the  sense  of 
having  fewer  positive  coefficients.  Thus,  for  instance,  if  we  choose 
j(i)  = 13,  j(2)  * 9,  and  h(l)  = 8,  h(2)  = 5,  we  can  generate  the  cut 

*17  + *19  £ 1 

(by  setting  « (12,13},  Q2  = {9,11});  and  for  j(l)  = 13,  j (2)  = 14, 
h(l)  * 8,  h(2)  » 4,  we  obtain  the  cut 


*3  + *19  > l 


(by  choosing  * {12,13}  and 


{14,20}). 


4.  Some  Properties  of  Cuts  from  Conditional  Bounds 

The  family  of  cuts  defined  bv  Theorem  2 is  vast,  and  one  is  interested 
of  course  in  computationally  cheap  procedures  for  generating  "strong"  members 
of  this  class.  In  this  section  we  investigate  some  properties  of  the  cuts 
(9)  that  will  be  helpful  toward  that  goal. 

The  first  practical  question  that  arises  is  whether  condition  (8)  can 
alwavs  be  met,  and  how.  Since  s depends  on  u,  it  should  not  be  surprising 
that  one  answer  to  this  question  comes  in  terms  of  additional  conditions  on  u. 

Theorem  4.  Let  the  vectors  u and  ¥ satisfy  (5),  and  let  x be  a cover 
with  support  S(x).  If 

u(Ax-e)  * 0, 


] 


16- 


then  (8)  holds  for  S * S(x). 

Proof.  Consider  the  pair  of  dual  linear  programs. 


(L 


j)  min  {cx|Ax  > e,  x^  > 1 , j eS  (If) , x > 0,  jeN\S(x)} 


and 


(D  ) max  {ue  + E s | ua  + s 

jeS(x)  J J J 


Cy  j«N ; u > 0,  s > 0}  . 


Clearly,  x is  a feasible  solution  to  (L^> , and  (u ,T)  is  a feasible 
solution  to  (D^) . Further,  x and  (u,s)  satisfy  the  complementary  slackness 
conditions  u(AT-e)  and  (x^-Ds.  - 0,  jeS(x),  x^s.  = 0,  j eN\S (*) ; hence  they 
are  optimal  solutions  to  (L^)  sod  (D^)  respectively.  Therefore 

ue  + E s.  = cx 

J«S(x)  J 

which  together  with  z^  < cx  proves  the  statement.|| 

For  any  cover  x,  denote 

T(x)  = {ieM|aix  = l}. 

Then  as  an  immediate  consequence  of  Theorem  4,  we  have 
Remark  4,1.  Let  x be  a cover,  and  let  (u,s)  satisfy  (5).  If  u also 
satisfies 


ut  = 0,  V ieMVT(x) 


then  (8)  holds  for  S = S(x). 

Thus,  if  an  upper  bound  z y and  vectors  u,  s satisfying  (5)  are  at  hand, 
but  condition  (8)  does  not  hold,  it  can  be  made  to  hold  by  successively 
setting  to  0 components  u.  of  u such  that  icM\T(5D.  At  worst  all  such 
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components  may  have  to  be  set  to  0;  then  (8)  will  hold. 

Before  turning  to  other  characteristics  of  the  cuts  (9),  we  now 
state  a basic  property  of  the  set  covering  problem.  Let  the  set  covering 
polvtope  P be  the  convex  hull  of  all  integer  n-vectors  satisfying  Ax  > e, 
x > 0,  i . e . , 

P = conv  (xeRn|Ax  > e,  x > 0,  x^  integer,  jeN}. 

We  then  have  the  following 

Theorem  5.  The  inequality 

(12)  Z x > 1 

j«N1  J 

where  ieM,  defines  a facet  of  P if  and  only  if  there  exists  no  keM  such 

that  N c N , N,  * N . 
k i k i 

Proof.  The  "only  if"  part  is  obvious.  To  prove  the  "if"  part,  we 

assume  there  is  no  keM  such  that  N,  CNN,  / N. , and  we  exhibit  n linearly 

k 1 k i 

independent  integer  n-vectors  that  satisfy  Ax  > e,  x > 0 and  for  which  (1) 
holds  with  equality. 

Let  (nJ  * p,  and  assume  w.l.o.g.  that  is  the  set  of  the  first  p 
indices  in  N.  Let  y = (1,...,1),  yeRn  P,  and  let  e^  and  f^  be  the  unit 
vector  in  Rp  and  Rn  p respectively,  whose  i-th  component  is  1.  Now  consider 
the  p n-vectors  (e  , v) , i»l,...,p,  and  the  n-p  n-vectors  (e  , y+f  ), 

1 1 1 -p 

i*p+l,...,n.  Since  there  is  no  keM  such  that  e*ch  of  these 

nonnegative  integer  vectors  satisfies  Ax  > e;  and  since  each  one  of  them 
has  a single  1 among  its  first  p components,  they  all  satisfy  (12)  with 
equality.  Further,  the  nxn  matrix  whose  rows  are  these  vectors  is 


0 
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where  for  k = p and  k » n - p,  1^  Is  Che  identity  of  order  k,  while  Y^  is 
the  kx(n  - p)  matrix  whose  entries  are  all  equal  to  1;  and  E is  the  (n  - p)xp 
matrix  whose  first  column  consists  of  l's,  and  whose  remaining  columns 
consist  of  0's.  Now  define  the  matrix 

-Y 


I Y 
P P 

-E 


\ 


n-p 


Using  the  fact  that  EY  = Y , it  is  easy  to  see  that  XZ  = I , i.e., 

p n-p  n 

Z = X and  hence  X is  nonsingular.  This  proves  that  the  n vectors 
introduced  above  are  linearly  independent . j| 

In  a cut-generating  procedure  it  is  important  to  make  sure  that  no  cut 
is  repeated.  Next  we  give  a necessary  and  sufficient  condition  for  a cut 
to  be  "new."  Let  (SC)  stand  for  the  set  covering  problem  amended  with  all 
the  cutting  planes  generated  up  to  some  point,  and  let 


(9)  Z x > 1 

J*W  J 

be  the  next  cut  generated.  We  then  say  that  the  inequality  (9)  is  new, 
if  there  is  no  ieM  such  that  N^  C W. 

Rema rk  5.1.  The  inequality  (9)  is  new  if  and  only  if  N\W  is  the 
support  of  a cover  for  (SC). 

Proof.  The  cut  (9)  is  new  if  and  only  if  N^JW,  VieM;  hence  if  and 
only  if  N^\W#0,  VieM.  But  this  condition  holds  if  and  only  if  N\W  is  the 
support  of  some  cover. !| 

While  the  condition  of  Remark  5.1  is  straightforward,  it  is  easier  to 
embed  in  a cut  generating  procedure  when  paraphrased  as  follows. 

Rema  rk  5 . 1 . a . The  inequality  (9)  is  new  if  and  only  if  it  cuts  off 
(is  violated  by)  some  cover  of  (SC). 


■ 
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The  next  Theorem  gives  conditions  on  the  column  indices  j(i)  and 
row  indices  h(i)  used  in  generating  inequality  (9),  to  guarantee  that  the 
inequality  obtained  cuts  off  a specified  cover.  We  will  denote 

M.  = {ieM|a..  = 1}  , jeN. 

Theorem  6.  Let  z , u,  v,  S and  , i=l be  as  in  Theorem  2, 

and  let  jCDeC^,  i = l,...,p.  If  7 is  a cover  such  that  S C S(x)  and 

(13)  h(i)eT(x)PM.(1),  i=l,...,p, 

then  the  inequality  (9)  cuts  off  (is  violated  by)  x. 

Proof.  Assume  S C S(jf)  and  (13)  holds.  From  h(i)eM.^^  we  have 
j(i)eNh(i),  i = l,...,p;  and  since  j(i)eScS(x)  implies  x^ (i)~  w^i  le 
h(i)eT(x)  implies  |S(x)DN^^^|  = 1,  1=1,..., p,  it  follows  that 

S(x)nNh(D  = {j  (i) } , i = l,...,p. 

Further,  since  j(i)eQ^,  1=1,..., p,  we  have 

S(x)n(Nh(i)\Q1)  = 0,  l-l,...,p, 

and  hence  S(Tf)PW  = 0,  i.e.,  the  inequality  (9)  cuts  off  x.|| 

Rema rk  6.1.  Every  inequality  (9)  for  which  the  conditions  of  Theorem  6 « 

are  satisfied,  defines  a facet  of 

P*  = conv  [xeRn|Ax>e,  Z x.>l,  x integer,  jeN}. 

jcW  J J 

Proof.  Follows  from  Remark  5.1  and  Theorem  5.|| 


Theorems  2 and  6 provide  rules  for  generating  a sequence  of  valid 
cutting  planes  that  are  all  distinct,  and  furthermore,  are  all  facets  of 
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the  current  polytope  P*.  This  latter  property,  however,  does  not  imply 
that  all  inequalities  generated  this  way  are  equally  strong.  Since  all  the 
inequalities  in  question  have  coefficients  equal  to  0 or  1 and  a right 
hand  side  equal  to  1,  we  will  use  the  number  of  coefficients  equal  to  1 as 
a measure  of  their  strength  (the  fewer  the  l's,  the  stronger  the  inequality). 
Note  that  some  facets  of  the  set  covering  polytope  may  be  much  weaker  than 
others,  according  to  this  criterion.  Thus,  for  instance,  all  5 inequalities 
represented  by  the  rows  of  the  matrix  A in  Table  4 define  facets  of  the 
set  covering  polytope  corresponding  to  A,  yet  inequality  4,  with  only 
two  l's,  is  much  stronger  than  inequality  5,  which  has  ten  l's. 


1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

Table  4. 

Thus,  although  they  all  define  facets  of  the  current  polytope  P*, 
the  cutting  planes  obtainable  via  the  rules  of  Theorem  6 are  not  all 
equally  desirable.  The  next  section  discusses  a procedure  for  generating 
conveniently  strong  members  of  the  family. 

5 . Generating  Cuts 

The  strength  of  an  inequality  (9),  i.e.,  the  size  of  che  set  W, 
depends  on  the  integer  p and  the  size  of  the  sets  N^^XQ^,  i = l,...,p, 
of  Theorem  6.  To  have  p conveniently  small,  the  procedure  chooses  the  set 


I 
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S = (j  (i) , . . . , j (p)  } , corresponding  to  the  p largest  reduced  costs  s^, 
jeS(x),  where  p is  the  smallest  integer  for  which  (8)  is  satisfied.  Each 
row  index  h(i),  i = l,...,p,  is  of  course  chosen  from  T(jF)nM.^^,  as 
prescribed  by  Theorem  6.  Further,  in  order  to  have  W as  small  as  possible, 
the  sequence  of  row  indices  h(i)  is  chosen  so  as  to  make  as  small  as 
possible  at  each  step  ke{l,...,p}  the  set  W^\W^  where  = 0 and 

“k  ■ ji/WV  • k ■ 1 "• 

Since  for  any  S satisfying  (8),  )s|  = 1 implies  (Remark  1.3)  that 
the  variable  x^  such  that  S = { j } can  be  permanently  set  to  0,  we  assume 
this  has  already  been  done  for  all  such  singleton  sets,  and  hence 
1 S | > 2 for  all  S satisfying  (8). 

Let  M and  N be  the  row  and  column  index  sets  of  the  current  problem 
(SC),  let  x be  a prime  cover  for  (SC),  and  denote,  as  before, 

S (x)  = {j  eN (xj  = 1 } , T (Tf)=  (ieMla^l). 

Further,  let  u and  s satisfy  (5),  and  assume  (8)  holds  for  S = S+A  [j cS (x) | s ^X)] . 

Cut-Generating  Procedure 


Step  0.  Initialize  W = 0,  S = S , z =ue,  i = 1 and  go  to  1. 

L 


Step  1.  Define 


8j  CD  = “g  3 J ’ 

Choose  h(i)  such  that 


Q = { j eN| Sj>s  j (1) } . 
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(breaking  ties  arbitrarily),  and  set 


W - W U 


(Nh(i)XQ) 


Z7  *"  ZT  + S • / • \ 

L L 1 (i) 


If  7t  > Zy,  go  to  step  2.  Otherwise,  let 


s . 
J 


j(i) 


jeQ^hCi) 

otherwise , 


S - S\{j(i)}, 


set  i — i+1,  and  go  to  1. 


Step  2.  Add  to  the  constraint  set  of  (SC)  the  inequality 


E x.  > 1. 
jeW  J 

In  at  most  |s+|  iterations,  this  procedure  generates  an  inequality  (9) 

satisfied  by  every  cover  x such  that  cx  < z^  and  violated  by  5T.  Indeed, 

4* 

S (initialized  as  S ) is  diminished  at  everv  iceration  by  one  element, 
hence  there  are  at  most  |S+|  iterations.  Further,  since  (8)  holds  for 
S = S+,  after  p < |s  | iterations,  (8)  holds  for  the  current  set  S (i.e., 
z > 7,  ),  and  we  go  to  Step  2 to  generate  a cut  (9).  For  the  sets 

jCDeQ^,  and  (7)  is  satisfied  (by  the  definition 
of  Q and  s^  at  every  iteration).  Finally,  the  choice  of  h(i)  guarantees 
(13).  Thus  all  requirements  of  Theorem  6 are  met. 

A couple  of  minor  improvements  are  at  hand.  Choosing  the  la  rgest  s 
to  define  j(i)  at  every  iteration  has  the  purpose  of  minimizing  the  size 
of  the  set  S in  (8).  But  at  the  last  iteration  choosing  the  largest  s 


j 


j 


may  not  be  indicated,  if  a smaller  s^  suffices  to  satisfy  (8).  Thus  a 


I 
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better  rule  for  choosing  j(i)  in  Step  1 is  to  set 

v.  = min  "(max  s.  , min  ,rs.|s.  > z..  - zT  1 ( 
jeS  j eS  J 

and  then  choose  as  j(i)  one  of  the  indices  j gS  for  which  r = v^ . 

Furthermore,  whenever  this  index  is  not  unique,  i.e.,  |j | > 1,  where 
J = [jes|  Sj  > v^},  the  choice  of  j(i)  and  h(i)  can  often  be  improved  by 
first  setting  Q = [jeN|s  > v^},  next  choosing  h(i)  so  as  to  minimize 
|Nh\QUW|  over  all  hgT(x)OMy,  where 

M = U M • 

J , T j’ 
j eJ 

and  then  choosing  the  unique  index  ^j}=jnN^.^  as  j C i ) - 

Example  3.  Consider  the  set  covering  problem  of  example  2 (Table  2) , 

with  c^  = 3 replaced  by  c^  = 1.  Then  the  cover  x whose  support  is 

S(x)  - [2,4,13,20]  gives  = cx  = 14,  and  T(x)=  M\(l}.  The  vector  u of 

example  2 yields  the  same  reduced  costs  s^  as  in  that  example,  except  for  s^, 

which  now  is  0.  The  lower  bound  ue  is  12,  and  since  s . > 14  - 12  = 2 for 

J “ 

j = 1,  18,  we  set  x^  = x^g  = 0,  and  replace  N by  N\[l,18}.  Condition  (8) 
holds  for  S = S+  = [13,20],  since  s ^ + s2q  > 2. 


Step  0.  W * 0,  S = [13, 20],  z.^  = ue  = 12. 

Step  1.  vt  = min  [ 1 , 2 } = 1,  J = [l3,20],  Q = [8,9,11,12,13,14,15,20], 

My  = ^3^20  = To  choose  h(l),  we  minimize  |N^\Q|  over 

hfiT(x)flMy  = M\[l,3,5],  and  find  that  the  minimum  is  1,  attained  for  k = 4,8,9. 

We  arbitrarily  choose  h(l)  = 4,  and  set  W = N^\Q  = [3],  z^  = 12  + 1 - 13. 

The  s.  remain  unchanged  except  for  j = 14,20,  the  new  values  for  the  latter 


i •«.  m. 


J 


-24- 


being  s^  = s?q  = 0.  We  set  S = [13],  i=2,  and  go  to 

Step  1.  v2  = min  {l, l]  = 1,  J = (13},  Q = [8,9,11,12,13,15], 

M = M = {l,8,10}.  To  choose  h(2) , we  minimize  |N  ,Q  j over 
J i -3  n 

heT(X)0MT  = [8,10],  and  find  h(2)  = 8.  We  set  W = (3}(J(N0\Q)  = [3,19], 

vJ  O 

z^  = 13  + 1 = 14,  and  since  > z^,  we  go  to 
Step  2.  We  add  to  (SC)  the  inequality 

x3  + x19  - l- 

6 . A Class  of  Algorithms 

The  cutting  planes  discussed  in  this  paper  can  best  be  used  in  a 
framework  that  takes  maximum  advantage  of  their  properties.  To  obtain 
a cutting  plane  from  conditional  bounds,  one  needs  a feasible  solution 
(u,s)  to  the  dual  of  the  linear  program  associated  with  (SC).  Such  a solu- 
tion also  provides  a lower  bound  ue  on  the  value  of  (SC).  On  the  other 
hand,  the  easiest  way  to  make  sure  that  the  cuts  that  one  generates  are 
all  distinct,  is  to  have  each  inequality  cut  off  some  cover  satisfying 
all  the  previously  produced  inequalities.  Thus  to  obtain  a sequence  of 
distinct  cutting  planes,  one  also  needs  a sequence  of  covers.  Each  cover  x 
in  turn,  provides  an  upper  bound  cx  on  the  value  of  (SC). 

The  best  approach  then  seems  one  that  alternates  between  (a)generating 
a cover  x for  the  current  problem,  and  (8)  generating  a dual  solution  (u,s) 


and  using  it  to  derive  an  inequality  that  cuts  off  x.  In  such  a procedure, 
the  value  of  (SC)  is  bounded  from  above  by  the  sequence  of  covers  obtained 
under  (<y) : and  bounded  from  below  by  the  sequence  of  dual  solutions  produced 


under  (3).  The  race  of  convergence  of  the  algorithm  is  the  rate  at 

which  the  gap  z - zT  between  the  two  bounds  decreases. 

u L 

Since  every  inequality  generated  in  the  procedure  cuts  off  at  least 
one  new  cover,  and  since  the  number  of  distinct  covers  is  finite,  the 
procedure  outlined  above  is  finite,  irrespective  of  the  methods  used  to 
generate  the  sequence  of  covers  x and  dual  solutions  (u.sl.  Its 
efficiency  on  the  other  hand  depends  crucially  on  the  efficiency  of  those 
methods . 

Several  versions  of  the  approach  outlined  above  were  implemented  and 
thoroughly  tested  in  a computational  study  summarized  in  the  companion 
paper  [21.  The  algorithm  that  emerged  as  a result  of  the  testing  uses 
several  different  heuristics  intermittently  to  generate  prime  covers,  and 
produces  dual  solutions  (u,s)  both  by  heuristics  and  by  subgradient 
optimization.  When  the  decrease  in  the  gap  z^  - z^  slows  down,  the 
algorithm  branches,  using  either  a disjunction  of  the  type  discussed  in 
this  paper,  or  a dichotomy  derived  from  other  considerations,  according 
to  some  measure  of  comparative  strength.  The  algorithm  is  particularly  well 
suited  for  low  density  problems,  and  its  performance  on  set  covering  problems 
taken  from  the  literature  compares  favorably  with  earlier  methods. 

Randomly  generated  test  problems  with  up  to  200  constraints  and  2000 
variables  have  been  successively  run. 

For  details  of  the  algorithm  and  results  of  the  computational  tests 
the  reader  is  referred  to  [21 . 
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which  would  be  a valid  lower  bound  if  the  constraint  set  were  amended  by  ■ 

certain  Inequalities,  also  called  conditional.  If  such  a conditional  lower  * 
bound  exceeds  some  known  upper  bound,  then  every  solution  better  than  the  one  j 
corresponding  to  the  upper  bound  violates  at  least  one  of  the  conditional  • 

inequalities.  This  yields  a valid  disjunction,  which  can  be  used  to  partition! 
the  feasible  set,  or  to  derive  a family  of  valid  cutting  places.  In  the  case  f 
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of  a set  covering  problem,  these  cutting  planes  are  themselves  of  the  set 
covering  type.  The  family  of  valid  inequalities  derived  from  conditional 
bounds  subsumes  as  a special  case  the  Bellmore-Ratliff  inequalities  generated 
via  involutory  bases,  but  is  richer  than  the  latter  class  and  contains 
i considerably  stronger  members,  where  strength  is  measured  by 'the  number  of 

j positive  coefficients..  We  discuss  the  properties  of  the  family  of  cuts  from 

conditional  bounds,  and^give  a procedure  for  generating  strong  members  of  the  ' 
family.  Finally,  we  outline  a class  of  algorithm  based  on  these  cuts.  Our  , 
approach  was  implemented  and  extensively  tested  in  a computational  study  whose 
results  are  reported  in  a companion  paper  [2].  The  algorithm  that  emerged  j 
. from  the  testing  seems  capable  of  solving  considerably  larger  set  covering 

problems  than  earlier  methods.  i 
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